Second eigenvalue of a Jacobi operator of hypersurfaces with 
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Abstract 

Let x : M — > be an n-dimensional compact hypersurface with constant scalar 

' curvature n(n— l)r, r > 1, in a unit sphere (1), n > 5. We know that such hypersurfaces 

f"*^ . can be characterized as critical points for a variational problem of the integral J M Hdv of the 

mean curvature H. In this paper, we derive an optimal upper bound for the second eigenvalue 
of the Jacobi operator J s of M. Moreover, when r > 1, the bound is attained if and only if M 
is totally umbilical and non-totally geodesic, when r = 1, the bound is attained if M is the 

Riemannian product § m (c) x S"- m (vT^?), 1 < m < n- 2, c = J , 
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1 Introduction 



|Xj ■ Let M be an n-dimensional compact hypersurface in a unit sphere S n+1 (l). We denote the 

components of the second fundamental form of M by hij, and denote the principal curvatures 
of M by ki, ■ ■ ■ , k n . Let H, Hi and H3 denote the mean curvature, the 2nd mean curvature and 
the 3rd mean curvature of M respectively, namely, 

1 n 2 

H = -y^h, H 2 = — ; — V k h k i2 , 

n — ' n(n — 1 ^-^ 

i=l v ' l<ii<i2<n 

H3= n(n-l)(n-2) S ^u^a- 

We denote the square norm of the second fundamental form of M by S. The Schrodinger 
operator J m = —A — S — n, where A stands for the Laplace-Beltrami operator, is called the 
Jacobi operator. Its spectral behavior is directly related to the instability of both the minimal 
hypersurfaces and the hypersurfaces with constant mean curvature in § n+1 (l) (cf. |19] and [3]). 
The first eigenvalue of the Jacobi operator J m of such hypersurfaces in S n+1 (l) was studied by 
Simons 1 191 and Wu 
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The second eigenvalue of the Jacobi operator J m of the compact hypersurfaces in §™ +1 (l) 
was studied by A. El Soufi and S. Ilias in [20]. They obtained that if M is an n-dimensional 
compact hypersurface in § n+1 (l), then the second eigenvalue A^™ of the Jacobi operator J m 
satisfies 

\ J 2 m < 0, 

where the equality holds if and only if M is a totally umbilical hypersurface in § n+1 (l). 
For any C 2 -function / on M, we define a differential operator 

n 

□/ = ( nHd a - M/tf> (i- 1 ) 

where (fij) is the Hessian of /. The differential operator □ is self-adjoint and it was introduced 
by S. Y. Cheng and Yau in [8 J in order to study the compact hypersurfaces with constant 
scalar curvature in § n+1 (l). They proved that if M is an n-dimensional compact hypersurface 
with constant scalar curvature n(n — l)r, r > 1, and if the sectional curvature of M is non- 
negative, then M is either a totally umbilical hypersurface S n (c) or a Riemannian product 
S m (c) x §> n ~ m (\/l — c 2 ), 1 < m < n — 1, where §> k (c) denotes a sphere of radius c. In [12], 
the first author proved that if M is an n-dimensional (n > 3) compact hypersurface with 
constant scalar curvature n(n — l)r, r > 1, and if S < in — 1) "( r ~ 1 )+ 2 _| — n ~ 2 then M 

\ ' 5 — ' — <> ' n—z n(r— 1)+2 ' 

is either a totally umbilical hypersurface or a Riemannian product S 1 (c) x S n_1 (v / 1 — c 2 ) with 
< 1 — c 2 = < Furthermore, the Riemannian product S 1 (c) x S n_1 (\/l — c 2 ) has been 
characterized in [5] and [6]. 

In m, Alencar, do Carmo and Colares studied the stability of the hypersurfaces with constant 
scalar curvature in S n+1 (l). In this case, the Jacobi operator J s is given by (cf. [1] and [7]) 

J s = — □ — {n(n — l)H + nHS — fy}, (1.2) 

which is associated with the variational characterization of the hypersurfaces with constant 

n 

scalar curvature in S n+1 (l), where f3=Yl^i ( c f- 02] an d [II])- The spectral behavior of J s is 

j=l 

directly related to the instability of the hypersurfaces with constant scalar curvature. 

In general, J s is not an elliptic operator. When r > 1, n 2 H 2 > S > 0, the differential 
operator □ and hence J s is an elliptic operator (cf. pages 3310, 3311 in [7]). When r = 1, if we 
assume that H3 ^ on M, then we have H ^ and J s is elliptic (cf. Proposition 1.5 in |llj). 

Definition 1: We call \f s an eigenvalue of J s if there exists a non-zero function / on M such 
that J s f = A/ s /, we call A? an eigenvalue of □ if there exists a non-zero function / on M such 
that □/ + Xff = 0, and we call A^ an eigenvalue of A if there exists a non-zero function / on 
M such that Af + Af / = 0. 

In [7J, Q. -M. Cheng studied the first eigenvalue of J s of the hypersurfaces with constant 
scalar curvature n(n — l)r,r > 1 in S n+1 (l), and derived an optimal upper bound for the first 
eigenvalue of J s . 

Theorem 1.1. (see Corollary 1.2 in J^j) Let M be an n-dimensional compact orientable hyper- 
surface with constant scalar curvature n(n — l)r, r > 1, in §>™ +1 (l). Then the Jacobi operator 
J s is elliptic and the first eigenvalue of J s satisfies 

\{ s < -n(n - l)rVr - 1, 



where the equality holds if and only if M is totally umbilical and non-totally geodesic. 



In [2], L. J. Alias, A. Brasil and L. A. M. Sousa studied the first eigenvalue A^ s of J s of the 
hypersurfaces with constant scalar curvature n(n — 1) in § n+1 (l). 

Theorem 1.2. (see Theorem 2 in JM/) Let M be an n- dimensional compact orientable hyper- 
surface with constant scalar curvature n(n — 1), in S" +1 (l), n > 3. Assume that H3 7^ 0, then 
the Jacobi operator J s is elliptic and the first eigenvalue X^ s of the Jacobi operator J s satisfies 

\{ s < -2n(n - 1) min \ H\, 



where the equality holds if and only if M is the Riemannian product S m (c) x E> n m (y/l — c 2 ) 

/ (n-l)m+-v/ (n-l)m(n-m) 
with 1 < m < n — 2, c = \ -, — rs • 

— — ' V n(n-l) 

In this paper, we study the second eigenvalue for J s of the hypersurfaces with constant scalar 
curvature n(n — l)r, r > 1 in S n+1 (l), n > 5, and we have the following results. 

Theorem 1.3. Let M be an n-dimensional compact orientable hypersurface with constant scalar 
curvature n(n — l)r, r > 1, in S n+1 (l), n > 5. Then, the Jacobi operator J s is elliptic and the 
second eigenvalue X'^ 3 of the Jacobi operator J s satisfies 

A^ < 0, 

where the equality holds if and only if M is totally umbilical and non-totally geodesic. 

Theorem 1.4. Let M be an n-dimensional compact orientable hypersurface with constant scalar 
curvature n{n — 1), in S n+1 (l), n > 5. Assume that H3 ^ 0, then the Jacobi operator J s is 
elliptic and the second eigenvalue A^ s of the Jacobi operator J s satisfies 

, t n(n — l)(n — 2) . , „ , , 
X J 3 < ^ ^ ; minimi, (1.3) 

where the equality holds if and only if H3 = constant 7^ and the position functions of M in 
S" +1 (l) are the second eigenf unctions of J s corresponding to X'^ 8 . In particular, when M is the 



Riemannian product S m (c) x S n - m (VT^), l<m<n-2, c = \J ( " 1 ) m +^_^ n m \ the 
equality in ()1 .3|) is attained. 



2 Preliminaries 

Throughout this paper, all manifolds are assumed to be smooth and connected without bound- 
ary. Let x : M — > S n+1 (l) be an n-dimensional hypersurface in a unit sphere S n+1 (l). We make 
the following convention on the range of indices: 

1 < k,l < n. 

Let {ei,-- - ,e n ,e n+ i} be a local orthonormal frame with dual coframe {u\,--- ,uj n ,u n +i} 
such that when restricted on M, {ei,-- - ,e n } is a local orthonormal frame on M. Hence we 
have ui n+ i = on M and we have the following structure equations (see [1], [9], [12] and [19]): 

dx = '^2uj i e i , (2.1) 



cfej = } jWjjej + 2^ hijujje n+ i - WjX, 

3 3 



(2.2) 



de n+1 = -} y hijujjd, (2.3) 

where hij denote the components of the second fundamental form of M. 
The Gauss equations are (see [S], [12] ) 

-RjjA:/ = Sikdji — 5u5jk + hikhji — huhjk, (2.4) 

Rik = (n— l)5ik + nHhik - ftijftjfc, ( 2 -5) 

j 

ij = n (n - l)r = n(n - 1) + n 2 # 2 - S, (2.6) 
where -R is the scalar curvature of M, r is the normalized scalar curvature of M and S = ^ ft?- 

is the norm square of the second fundamental form, H = - ^ ha is the mean curvature of M. 

i 

The Codazzi equations are given by (see [9], [12]) 

hijk — hikj. (2-7) 

Let / be a smooth function on M, we define its gradient and Hessian by (see [9], [12] ) 



df = ^2fiUi, (2. 



i=l 



i=i j=i 



Then the Jacobi operator J s (see (jl.2p ) is defined by 

J 8 f = -□/ - {n(n - 1)# + ntfS - f 3 }f 



(2.10) 



I. J 



3 Some examples and some lemmas 

First of all, we consider the first and second eigenvalues of the Jacobi operator J s of the totally 
umbilical and non-totally geodesic hypersurface in S n+1 (l) with constant scalar curvature n(n — 
l)r, r > 1 and the Riemannian product § m (c) x S n_m (\/l — c 2 ), 1 < m < n — 2 with constant 
scalar curvature n(n — 1) in §> n+1 (l), n > 3. 

Example 3.1. Let M be a totally umbilical and non-totally geodesic hypersurface with constant 
scalar curvature n(n— l)r, r > 1 in S ra+1 (l). We can assume H > 0. In this case, □ = (n—l)HA, 
from S 1 = n.ff 2 and the Gauss equation (12. 6ft we have -ff = \/r — 1. By (jl.2p we have 

J s = -U- {n(n - 1)H + nHS - f 3 } = -{{n - l)HA + n(n - l)H(l + F 2 )}, 

hence the eigenvalues Xf B of J s are given by 

= (n - l)HAf - n(n - l)H(l + H 2 ), 

where A^ denotes the eigenvalue of A (see Definition 1). It is well-known that A A = 0, A A = 
nr = 77,(1 + H 2 ), hence we have 

\(* = - n (n - 1)H(1 + H 2 ) = -n(n - l)ry/r - 1 < 0, 

\£ = (n - 1)J3" • n(l + F 2 ) - n(n - 1)H(1 + F 2 ) = 0. 31 



Example 3.2. Let M be the Riemannian product 



S m (c) x S n - m ( V / l - c 2 ), 1 < m < re - 2, c = 
in § n+1 (l), n > 3. In this case, the position vector is 



(n — l)m + \/ (n — l)m(n — m) 
re(re — 1) 



x = ( Xl)X2 ) G § m ( c ) x § n " m (v / l - c 2 ) 



and the unit normal vector at this point x is given by e n +i = { c c " x\, — c % x 2)- 
Its principal curvatures are given by 



7> 



Vl - c 2 c 
fcl = • • • = fc m = , fcjTi+i = • • • = k n = - . (3-2) 

c V 1 - c 2 

Since the principal curvatures are constant hence H, S, f$ are all constant given by 

H 



nc 2 — m 
cra\/l — c 2 



m(l - c 2 ) (re - m)c 2 2 2 , , 

* = 5 1 ; 5— =n H , {6.6) 

f m(l — c 2 ) 3 / 2 (re — rre)c 3 



c 3 (l- c 2)3/2- 

After a long but straightforward computation, we know that M has constant scalar curvature 
re(re — 1) and 

2H 2(rec 2 -m) , , 

#3 = = 7= < 0, 3.4 

re- 2 cre(re-2)VT^ 2 

hence the Jacobi operator J s is elliptic (cf. Proposition 1.5 in [H]). We also have 

(re - 2Tre)(re - l)c 4 + 2m(m - l)c 2 - ret(Tre - 1) 
n{n-l)H + nHS- h = — _ ^ , (3.5) 

thus the Jacobi operator J s = — □ — {re(n — 1)H + nHS — fa} becomes 

(re — 2m)(n — l)c 4 + 2rre(m — l)c 2 — m(m — 1) 
JS = - D C 3(l-C 2 )3/ 2 ' (3 ' 6) 

hence, the eigenvalues X'^ 3 of J s are given by 

j s □ (re — 2m)(n — l)c 4 + 2m{m — l)c 2 — m(m — 1) 

= « c 3(i _ c 2)3/2 ' ^ 3 ' 7 ' ) 

where A? denotes the eigenvalue of the differential operator □ (see Definition 1). 

Since the differential operator □ is self-adjoint and M is compact, we have = and its 
corresponding eigenfunctions are non-zero constant functions, hence 

j (re — 2rre)(re — l)c 4 + 2m{m — l)c 2 — m{m — 1) 

V = C 3(l_ c 2)3/2 • ( 3 - 8 ) 



Let {ei, • • • , e n } be a local orthonormal basis of TM with dual basis {wi, • • • , uj n } such that 
{ei, • • • , e m } is a local orthonormal basis of TS m (c) when restricted on S m (c) and {e m +i, • • • , e n } 
is a local orthonormal basis of TS n-m (\/l — c 2 ) when restricted on 8 n-m (\/l — c 2 ). So we have 

m n 

nf = J2(nH-ki)fu+ Yl (nH-k n )f jj = (nH-k l )A 1 f + (nH-k n )A 2 f, (3.9) 

i=l j=m+l 



where Ai and A2 denote the Laplace-Beltrami operators on § m (c) and S n m (s/l — c 2 ) respec- 

(n— l)c 2 — (m— 1) . n / xt j \ (n—l)c 2 —m 



tively. Since (ni? — fci) = ^ — ™ — - > 0, (nH — k n ) = , a m > 0, we conclude that 



A° = mm{(nH - ki)\f\(nH - k n )\£ 2 }, (3.10) 

where A^ 1 and A^ 2 are the second eigenvalues (or the first non-zero eigenvalue) of Ai and A2 
which are given by 

\ Ai m A 2 n ~ m 

A 2 = -9, A 2 = -. (3-11) 

cr 1 — cr 

Therefore, from (|3.10p and (|3. 1 1 1) . after a direct computation, we have 

m (n — 2m)(n — l)c 4 + 2m(m — l)c 2 — m(m — 1) 



A^ = mm{(nH - k%)- 



c 3 (l -c 2 ) 3 / 2 



n — m (n — 2m) (n — l)c 4 + 2m(m — l)c 2 — m(m — 1) 
(nH - k n )j—j c 3 (1 _ c2) 3/2 > ( 3 - 12 ) 

(n — m)[(l — n)c 2 + m] —m[(n — l)c 2 — (m — 1)] 

= mln i c (! _ c 2)3/2 ' c 3(! _ c 2)l/2 >• 



: (n— l)m+A/(n— l)m(n— m) , 

Since c = \ j n(n-i) ' we have 



(n — m)[(l — n)c + m] m[(n — l)c — (m — 1)] 



c (l_ c 2)3/2 C^l-C 2 ) 1 ^ 

n(n — l)c 4 + 2m(l — n)c 2 + m(m — 1) 



c 3(!_ c 2)3/2 

It follows from (j3~T2j) and ([313]) that 



0. 



c(l - c 2 ) 3 / 2 

On the other hand, we also have 

(n — 2m)(n — l)c 4 + 2m(m — l)c 2 — m(m — 1) 
c 3(l _ c 2)3/2 

(2c 2 - l)(n(n - l)c 4 + 2m(l - n)c 2 + m(m - 1)) 



c 3(! _ c 2)3/2 

(n — m)[(l — n)c 2 + m 



+ 2n(n- 
0, 



+ n(n - l)i? 



c(l - c 2 ) 3 / 2 
n(n — l)c 4 + 2m(l — n)c 2 + m(m — 1) 
c(l - c 2 ) 3 / 2 



(3.13) 



A* = (n " m)[(1 "l C 9 2 + m] < 0. (3.14) 



(3.15) 



(3.16) 



and 

(n — m)[(l — n)c 2 + m] n(n — l)(n — 2) 

c(1 " C2)3/2 * 3 (3 17) 

(n(n - l)c 4 + 2m(l - n)c 2 + m(m - l))(c 2 (2n - 1) - 2m + 1) _ 

~ C 3(l - c 2)3/2 = °» 

hence, from (pT8]) . (|Q3]> . (|515|> . (l3TT6j) and pTf]) . we have 

Af* = -2n(n - < \£ = -n(n - 1)H = n(n ~ ^ ~ 2) ff 3 < 0. (3.18) 

In the following we will assume that x : M — > 8 n+1 (l) is an n-dimensional compact orientable 
hypersurface with constant scalar curvature n(n — l)r, r > 1, in S n+1 (l), n > 5, when r = 1, 
we assume moreover #3 7^ 0. When r > 1, we have n 2 H 2 > S > 0, when r = 1, since #3 7^ 0, 
we have H ^ 0. Hence, we can assume H > (cf. [7 J and |llj). 

Let o be a fixed vector in M. n+2 . We define functions f a : M — > R and g a : M — ► R by 

f a =< a, x >, <f =< a, e n+ i >, (3.19) 

where x is the position vector and e n+ \ is the unit normal vector. 

By using the structure equations and the definition of the covariant derivatives, we have the 
following result. 

Lemma 3.3. (see W) The gradient and the second derivative of the functions f and g are given 
by 

ft =< a,a >, /?■ = g a hij - f a 5ij, 



9i = - y~] < a, ej > hij, g°- k = ~y~] < a, a > h ijk - ^ g a hijh ik + f a h jk . 

i=l i=l i=l 

Proof. By (|2.ip we have 

df a =< a, dx >= < a i e i > u ii 

i 

thus from (12.81) we have 



(3.20) 



ft=<a,ei>. (3.21) 

From ([22]) and (ET2T1) we have 

n n n 

^2 = d h + ^2 h^i 1 =< °' d&i > + X] < °' e J > W J* 
j'=i i=i i=i 

n 

= < a, e n+ i > hijUJj— < a, x > oji, 
3=1 

hence we have 

/* =< a, e n+ i > fty- < a, x > = jp/iy - / a <%. (3.22) 
After an analogous argument, we have 

n n n 

g] = - ^ < a,ei > h^, g a jk = - < a, a > h ijk - ^2g a hijh ik + f a h jk . (3.23) 

i=l i=l i=l 

□ 



We will use a technique which was introduced by Li and Yau in [13] and was later used by 
other authors (see [H], [16] and [21]). 

Let B n+2 be the open unit ball in R n+2 . For each point g £ B n+2 , we consider the map 

= P+fc<P,g>+A)g v g §n+1 c Rn+2 
A(< p,g > +1) 

where A = (1 — Hgll 2 ) -1 / 2 , /i = (A — l)||g|| -2 and <, > denotes the usual inner product on R n+2 . 
A direct computation (see |14j . |21j ) shows that F g is a conformal transformation from S" +1 (l) 
to § n+1 (l) and the differential map dF g of F g is given by 

dF g (v) = \- 2 (< p,g > +1)~ 2 {A(< p,g > +l)v - A < v,g > p+ < v,g > (1 - X)\\g\\- 2 g}, 

where v is a tangent vector to § n+1 at the point p. Hence, for two vectors v , w G TpS n+1 we 
have (see [H], [E] and |2T]) 



i- Ibll 2 

< dF g (v),dF g (w) >= > < v,w > . 

By use of the technique in Li- Yau |T3j, we have the following result: 

Lemma 3.4. (see fLfl, \W$ and JjSJ/j 

Let x : M — > S n+1 be a compact hypersurface in § n+1 with constant scalar curvature n{n — 
l)r, r > 1, and u be a positive first eigenfunction of the Jacobi operator J s on M, then there 
exists g £ B n+2 such that J M u(F g o x)dv = (0, . . . , 0). 

Let {-E^j^jl 2 be a fixed orthonormal basis of R n+2 , for a fixed point g £ B n+2 , we define 
functions f A : M -> R(l < A < n + 2) by 

A A < E A ,x> +(fi < x,g >+\)<g,E A > 

f =<E ,F g o X >= -r- — — , Vl<,4<n + 2. (3.25) 

\(<x,g>+l) 

Lemma 3.5. The gradient of f is given by 

ft = * EA,ei> „ + w <9,et> ^ (- <E A ,x> < g, E A >). (3.26) 

\(<x,g>+l) \{<x,g>+l) 2V X\\g\\ 2 

Proof. By applying Lemma 3.3, we have 

jA = < eA i ej>+^< g, ej >< g, E A > _ ^ A <g,e { > 



\(<x,g>+l) <x,g>+l 

<E A ,ei> <g,e,i> . A ^ A A 

(p, < g, E > — < E , x > —A < g, E A >) 



A(<x,g>+1) A(<x,#>+1) 2 

u <EA ' Gl> u + u <9 ^> {~ <E\ X > +\^ 2 < 9, E A ». 
\(<x,g>+l) \{<x,g>+l) 2y X\\g\\ 2 

□ 



We also need the following Lemma 3.6, Lemma 3.7 and Lemma 3.8 to estimate the second 
eigenvalue of the Jacobi operator J s on M. 



Lemma 3.6. Let M be an n- dimensional compact hypersurface with constant scalar curvature 
n(n — l)r, r > 1, in § n+1 (l). Let f A be the function given by (I3,25p . we have 



(3.27) 



A=l 



Proof. By divergence theorem and Lemma 3.5 we have 

n+2 „ n+2 



A=l Jm A=l id 

n+2 . _ 



n + 2 /• ^ z?A 

+ w^^^TT^" < > + aTHT^ < 9,E A >)) 



< £^,e, > : < g,e t > , ^ 1 - A A 



•A(<x,r7>+1) \(<x,g>+iy" ' A|| 5 || 2 

• <aR^T> + K <:ZW - < EV ' =" + WF < >,)d " 

= j M &H Sii - M1 A2(< ^ >+1)2 + A^^/^ PC - W< *■* > + 1 > 
+ A 2 ||<,|| 2 - 2(1 - A)A < i,s > +(1 - A) 2 ]]}*, 

= jj:{nm l3 -h l3 ). x2{<x « >+i)2 dv 

n{n-l)H{l-\\gf) dv 

\, (• •'•.// > • l ;- 

(3.28) 

n+2 

where we use the fact that £ < Ea,X >< Ea,Y >=< X,Y > (\f X,Y e R n+2 ) in the third 

A=l 

equality. 

By Newton formula, we have 

" 2 2 (3.29) 

5 = ra 2 # 2 -n(n- l)fT 2 . 

Thus J s becomes 

J a = -U- {n(n - 1)H + nH(n 2 H 2 - n(n - l)H 2 ) 
(nV + n(n-l)(n-2) g> _ *»'(»- D Ml)} 

= -□-„(»- 1)J? - " 2 (" 2 - 1) g g2 + -»>("- 2 > g3 (3 - 30) 

= -□ - " ( " ~ 1) (2g - (n - 2)H, + nHH 2 ). 
Then by using the fact that 

n+2 n+2 

^2f A -f A =Y j <E A ,FgO X >< E A , FgOX > = < FgO X ,FgOX >= 1, (3.31) 

A=l A=l 

we immediately get (|3.27p . □ 



For a fixed point g £ B n+2 , let 

f=<x,g>, g =< e n+1 ,g >, p = - In A - In (1 + /), (3.32) 
where A = (1 — ||<?|| 2 ) _1 / 2 , a? is the position vector and e n +i is the unit normal vector. We have 

" A 2 (l + /) 2 - (<x,g> +1) 2 1 + / ' 1 + / (1 + /) 2 ' 

Lemma 3.7. Ze£ x : M — >■ S n+1 (l) be an n- dimensional compact hypersurface with constant 
scalar curvature n(n — l)r, r > 1, in S n+1 (l). When r = 1, we assume moreover that H$ ^ 0. 
Then we have H ^ 0, hence we can assume H > 0. Let p be the function defined by (I3.32p . we 
have 

I ^—^Tzk dv ^ I (H + ^)dv- [ [H\\Vp\\ 2 -—^—- YtinHSij-h^pipAdv, 

JM{<x,g>+iy j M h j m n \ n - l )~i 

(3.34) 

and the equality holds if and only if H 2 + f^j = on M. 

Proof. Under the hypothesis of the lemma, we can assume H > (cf. [7] and [2]). We have 
J2(nH Sij - hij )p iPj = £>i^ - = ~ £ (T^' (3 - 35) 

and 

Hp = ^2(nH5ij - hij)pij = Y,( nHS ij ~ + (1 + f )s 

-A/raff nff HV/II 2 v ^ v hjj/i/j 
1 + / (1 + /) 2 + / t/ (1 + /)2 ' 

From (|3.33|) . (|3.35|) and ()3.36p and by using Lemma 3.3, we have 

cp - - <•<><«) ■ ^ + 

—AfnH , ^hijfij. 2 , - IMI 2 ) 



(3.36) 



1 l + .f 4^1 



+ 



1 + / ' 4- l + r n(n-l) ' (1 + /) 2 
nH(nHg - nf) ^ hij(ghij - f '<%). 2 F(l 



" l 1 + / ^ 1 + / J 'n(n-1) + + 

2Hf-2H 2 g Hi ~ l -f 2 -^tf-~9 2 ) g/ 2 ^2 2g2 ~ 

1 + / (1 + /) 2 v( 1 + ^) 2 ( 1 + ^) 2 1 + ^ 
- F -Z.(TT7) 2 + ^- h -^ + ^-^IIVpI| x , 

which immediately implies 

/ ,5 (1 ~"£U 

7m (< x,g > +1) 2 

r h 2 2 (H 2 + ML ) 2 ^ 3-37 ^ 

= j M [H + li- mVpf + - - - — iT^^- 

Hence we get the inequality ()3.34p and the equality holds if and only if H2 + = on M. □ 



Lemma 3.8. Let M be an n- dimensional compact hypersurface with constant scalar curvature 
n(n — l)r, r > 1, in §™ +1 (l), n > 5. When r = 1, we assume moreover that H3 7^ 0. Then we 
have H / 0, hence we can assume H > 0. PFe have 

I [H\\Vpf - 2 ^(n^- - fHj)pi P j\dv > 0. (3.38) 

Proof. Under the hypothesis of the lemma, we can assume H > (cf. [7] and (2j). Vp£ M, let 
k\, . . . ,k n denote the principal curvatures of M at p, we choose an orthonormal basis such that 
hij = 5ijk{. By Gauss equation (I2.6p . we have 

n 2 iI 2 -^A;? = n(n-l)(r-l) > 0, (3.39) 

i 

which leads to 

nH > \ki\, y\<i<n. (3.40) 
As n > 5, we have n ( n 2 ~ 3 ) > n ff ; so we have 

^l|Vp|| 2 - 2 ^(nil^ - 
n n — 1 ^-^ 

= H Y,P 2 i~ n ( n -i) ^Z( nH5 ij ~ kjh)piPj 

i i,j 

= H E - E ( 2 u ( nH - k ^ 

L — ' n(n — 1) 

i 1 

,n(n -3) 2 



n(n 



T) E PK-^Y^H + fc) > £ P i(nH - M) > 0. 



Hence, we get if||Vp|| 2 — w ( w 2 _ 1 ) YKjiHSij — hij)pipj > holds at every point of M, which 



immediately implies (|3.38p . □ 



4 Proofs of Theorem 1.3 and Theorem 1.4 

Proof of Theorem 1.3: Since r > 1, we have □ is an elliptic operator and H 7^ 0. Hence, we 
can assume H > (see [7]). Let it be a first eigenfunction of J s , we can assume u is positive on 
M, by Lemma 3.4 there exists g S B n+2 such that 

/ u(F g ox)dv = {0,...,0), (4.1) 
Jm 

which implies that the functions {f A , 1 < A < n + 2} given by (I3.25P are perpendicular to the 
function u, i.e., f M u • f A dv = 0, VI < A < n + 2. Then by using the min-max characterization 
of eigenvalues for elliptic operators, we have 

^ ■ [ (f A - f A )dv < [ (J s f A ■ f A )dv, V 1 < A < n + 2. (4.2) 
Jm Jm 

n+2 

Summing up and using the fact that ^ f A ■ f A = 1 (see (|3.3ip ). we obtain 

A=l 

n+2 „ 

• Vol(M) < V / ( J s f A ■ f A )dv. (4.3) 
A=l Jm 



From Lemma 3.6 and (j4.3j) we have 

|2 



\l°.Vol{M)< I' n(n-l)H{l-\\ g \\) dv _ I' _ _ (zU) 

Then by (|4.4[) . Lemma 3.7 and Lemma 3.8, we have 

A^ • Vol(M) < n(n - 1) • / (if + - / — ~ ^ (2H - (n - 2)H 3 + nHH 2 )dv 

Jm H J m 2 



, , M n-2 TT nHH 2 . 

n ~ ' y ^ + — 2~ } 



(4.5) 



From definition of i?2 and the Gauss equation (|2.6p we have 

H 2 = r — 1 = constant > 0. (4.6) 
So we have H 3 < and #2 < -ff (see [10], p. 52) and hence 

^ • Vol(M) < n(n - 1) • Jj§ + ^tf 3 - ^)dv 

. /" ,#2 n-2H$ nHH 2 , fA - s 
< n{n - 1) • jf (-^ + — - — 2-^)<fc ( 4 -7) 

= n(n-l)- / — H-£-H)dv<0, 
Jm 1 a 

therefore we get A^ < 0. 

When A^ 8 = 0, then all the inequalities become equalities. From (|4.7f) we have H 2 = H 2 
on M, since H 2 is a positive constant, we get M is a totally umbilical and non-totally geodesic 
hypersurface with constant scalar curvature n(n — l)r. On the other hand, if M is a totally 
umbilical and non-totally geodesic hypersurface with constant scalar curvature n(n — l)r, from 
Example 3.1 in section 3, we know that A^" =0. □ 

Remark 4.1. We notice that from (|4.7p we can get a more precise upper bound for , that 
is, 

j , Hn n — 2 TT nH 2 TT . 
A 2 S < n(n — 1)( 1 maxi/3 mini/ ) 

111111 2 2 2 / ,N ( 48 ) 



..(r-1) 2 n-2 n(r-l) 

n(n — 1)( 1 maxi/3 mini/) 

v A mini? 2 2 7 



Proof of Theorem 1.4: Since r = 1, from (j4.6j) we have #2 = 0. Since we assume that H 3 
does not vanish on M, we have J s is elliptic and the mean curvature H does not vanish on M(cf. 

Proposition 1.5 in [LT]). Hence, we can assume H > 0. Thus H% < = 0. Since we assume 
that #3 ^ on M, we get H3 < 0. As Lemma 3.6, Lemma 3.7 and Lemma 3.8 hold for both 
the case r > 1 and the case r = 1, after an analogous argument with the proof of Theorem 1.3, 
we know that (|4.ip - (|4.5p still hold in this case, hence we have 

,Hl + n-2 TT nHH 2 
JM H 2 
n{n — l)(n — 2 



\ J 2 ° ■ Vol(M) < n(n - 1) • / + — H 3 - —-^)dv 



2 



< n(n -^ (n - 2) maxg 3 -V^(M) 
= _n(n-l)(n-2) ^ ^ 



\i (4.9) 



Hence, we get 



, j n(n — l)(n — 2) 

x j s < — v j± )_ min |^ 3 |_ (4 10 ) 



When A 2 S = _ "(" 1 )( n 2 ) m i n \H 3 \, the inequalities in (|3.34p . (|4.2p and (|4.9p become equali- 
ties. The equality in (|4.9p holds implies that #3 = constant 7^ 0. Since Hi = 0, the equalities in 
(|3.34p holds implies that g =< g,e n +\ >= on M. We claim that g must be 0, otherwise, we 
have that M is a hypersphere (see Theorem 1 in [H]), hence M is totally umbilical, since Hi = 0, 
we immediately get M is totally geodesic which is a contradiction with H3 7^ 0. Hence we have 
g = 0, from (|3.25[) we get f A =< E A , F g o x >=< E A , x >, which means {f A , 1 < 4 < n + 2} 
are the position functions of x : M — > § n+1 (l). Since the equality in (14.2)) holds, it follows that 
the position functions {f A =< E A ,x >, 1 < A < n + 2} must be the second eigenfunctions of 
J s corresponding to X^" ■ 

On the other hand, if we assume that H3 = constant 7^ and the position functions {f A =< 
E A ,x>, 1 < A < n + 2} are the second eigenfunctions of J s corresponding to A 2 S . Since H3 / 0, 
we have H 7^ 0. Hence, we can assume H > 0, H% < (cf. Proposition 1.5 in [llj). 

Since H2 = 0, by using (11. ip and (13.20p . we get 

Uf A = n(n - l)H 2 < E A , e n+1 > -n(n - l)Hf A = -n{n - l)Hf A , V 1 < A < n + 2, 

then from (|1.2|) and (|3.29p we have 

J s f A = n(n - l)Hf A - {n(n - l)H + nHS - f 3 }f A 
= (/ 3 - nHS)f A 

= {(n 3 ^ 3 + "fo- 1 ^"- 2 )^ _ 3n 2 (n-l) gff2) _ ^ _ n2(n _ 1)Hffa)} ^ 

= n(n 'f- 2) ^,via<, + 2, 

1 . \ J, n(n— 2) t-t ri(n— l)(n— 2) ■ i tt I 

hence we get A 2 = — ' ^ -"3 = — 2 mm l-"3r 



In particular, when M is the Riemannian product S m (c) x § n m (Vl — c 2 ), 1 < m < n — 2 

with c = ^ n 1 ^ m+ nfa-r)* Tn ^ n from Example 3.3 in section 3, we know that the equality in 
(|4.10p is attained. □ 

Remark 4.2. Since Lemma 3.8 does not hold when n = 3 and n = 4, we can not prove Theorem 
1.3 and Theorem 1.4 by our technique in n = 3 and n = 4. So it is an interesting problem to 
study the estimate for the second eigenvalue of the Jacobi oeprator J s of the hypersurface 
x : M n -> S n+1 (l) when n = 3 and n = 4. 
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